Text-driven Automatic Image Sequence Generation using Facial Modeling for Digital TV News Production System
نویسنده
چکیده
This paper presents a facial modeling approach for automating the head-and-shoulder image sequence generation for digital TV news video clips production which is the most expensive part in terms of manpower and cost. With the IPA phonetics transcribed from news script being the driving parameter, the high precise adapted 2-D wireframe model on a frontal view of speaker image with sufficient facial textural information will be used to define the associated facial action units (AFAUs) corresponding to the phonemes. This developed facial modeling approach increases the intelligibility of facial non-verbal communication for potential audiovisual lip-synch application like TV news video clips, video telephony, Story Teller On Demand (STOD), lip-reading for the deaf or the hearing-impaired.
منابع مشابه
Text-Driven Automatic Frame Generation Using MPEG-4 Synthetic/Natural Hybrid Coding for 2-D Head-and-Shoulder Scene
In this paper, we propose a facial modeling technique based on the MPEG-4 Synthetic/Natural Hybrid Coding for automating frame sequence generation of a talking head. With the definition and animation parameters on a generic face object, the shape, textures and expressions of an adapted frontal face can generally be controlled and synchronized by the phonemes transcribed from plain text. By th...
متن کاملImprovement of generative adversarial networks for automatic text-to-image generation
This research is related to the use of deep learning tools and image processing technology in the automatic generation of images from text. Previous researches have used one sentence to produce images. In this research, a memory-based hierarchical model is presented that uses three different descriptions that are presented in the form of sentences to produce and improve the image. The proposed ...
متن کاملAutomatic Generation of a Multi Agent System for Crisis Management by a Model Driven Approach
Considering the increasing occurrences of unexpected events and the need for pre-crisis planning in order to reduce risks and losses, modeling instant response environments is needed more than ever. Modeling may lead to more careful planning for crisis-response operations, such as team formation, task assignment, and doing the task by teams. A common challenge in this way is that the model shou...
متن کاملAutomatic textual annotation of video news based on semantic visual object extraction
In this paper, we present our work for automatic generation of textual metadata based on visual content analysis of video news. We present two methods for semantic object detection and recognition from a cross modal image-text thesaurus. These thesaurus represent a supervised association between models and semantic labels. This paper is concerned with two semantic objects: faces and Tv logos. I...
متن کاملAutomatic text regions location in video frames
Content-based information retrieval from digital video databases and media archives is a challenging problem and is rapidly gaining widespread research and commercial interest. For a reliable retrieval and intelligent access to video programs, indexing should provide semantic descriptors. One way to include more semantic knowledge into the indexing process is to use the text embedded within ima...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1997